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INTRODUCTION 

The  matter  of  the  effectiveness  of  clinical  prediction 
as  compared  to  that  of  statistical  prediction  ha3  long  been 
a  point  of  disagreement  among  psychologists,   '.hile  many 
eminent  authorities  have  made  emphatic  statements  as  to  the 
superiority  of  each  method,  in  the  minds  of  most  there  remains 
some  doubt  as  to  their  relative  effectiveness.   It  is  not  the 
purpose  of  this  thesis  to  prove  or  disprove  any  theories 
already  advanced  on  the  subjoct,  but  rather  to  limit  this 
further  study  to  ascertaining  the  effectiveness  of  both  types 
of  predictions  as  they  might  be  used  in  relation  to  selected 
problems  of  prediction  at  Kansas  State  College,  Manhattan, 
Kansas. 

Entering  freshmen  at  Kansas  State  College  are  given  a 
battery  of  tests  designed  to  give  a  picture  of  the  individ- 
ual: his  general  aptitude,  achievement  in  several  fields, 
personality  adjustment,  and  interests.   It  is  then  presumed 
to  be  possible  for  the  clinician  to  use  this  Information  in 
toto  or  in  part  in  aiding  the  individual  to  develop  his  self 
concept,  to  develop  his  capacities  to  the  utmost,  and  to 
achieve  a  more  adequate  adjustment,  thus  a  more  successful 
college  life— if  the  student  desires  this  help.   Proponents 
of  this  hypothesis  have  made  many  statements  justifying  it. 
Burgess  and  Cottrell  (5)  say  that  because  statistical  methods 
deal  with  averages  and  probabilities  that  dynamic  combinations 


of  behavior  are  excluded.   Isidor  Che In  (6)  states  that 
"The  clinician  sees  statistics  as  one  tool  In  his  major  meth- 
odological objective  of  conceptually  or  actually  manipulating 
circumstances  to  arrive  at  an  understanding  of  the  conditions 
of  events."  He  feels  that  the  clinician  is  not  concerned 
with  only  quantitative  variables}  he  wants  to  know  how  these 
variables  affect  the  individual. 

There  are,  however,  several  areas  into  which  one  must  In- 
quire before  accepting  this  hypothesis  fully.  With  each  in- 
dividual and  therefore  with  each  individual^  judgment  one 
must  recognize  that  the  personal  equation  will  come  into  play. 
No  one  views  any  matter  in  exactly  the  same  light*  To  what 
extent  will  the  judgments  of  several  individuals  using  the 
same  data  vary?  Will  the  training  and  experience  of  the 
clinician  greatly  affect  his  clinical  judgment? 

Sarbin  (18)  states  that  clinical  judgments  are  made  on 
the  basis  of  1)  deductions  from  known  and  tested  generali- 
zations, 2)  deductions  from  plausible  but  untested  hypotheses, 
3)  deductions  from  false  generalizations,  and  4)  so-called 
intuitions.   Can  one  depend  on  judgments  made  in  this  manner? 
Are  clinicians  accomplishing  their  purpose  or  does  the  clinical 
judgment  err  more  than  those  made  from  statistics  with  a  known 
margin  of  error?  Sarbin  (18)  made  a  study  on  clinical  pre- 
diction of  academic  achievement  as  compared  with  predictions 
made  from  regression  equations.   He  states:  "Prom  this  study 
we  can  say  with  some  assurance  that  the  prediction  of  academic 
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success  or  failure  can  be  done  simpler  and  with  more  accuracy 
by  the  statistical  method." 

There  are  the  two  schools  of  thought.   It  is  important 
to  discover  which  is  the  more  effective  method  of  utilizing 
the  data  gathered  on  each  new  student  entering  Kansas  State. 
In  pursuing  this  study  the  following  questions  will  be  con- 
sidered: 

1)  Is  prediction  by  a  single  test  as  adequate  as  predic- 
tion by  clinical  judgments? 

A)  Is  prediction  of  academic  success  or  failure  by 
the  American  Council  on  Education  Psychological  Examination 
as  accurate  as  prediction  by  the  clinician? 

B)  Is  prediction  from  the  Strong's  Vocational  Inter- 
est Blank  as  to  the  suitability  of  the  student's  curriculum 
as  accurate  as  prediction  by  the  Individual  counselor  using 
a  battery  of  tests? 

2)  Is  the  clinical  judgment  of  the  experienced  counselor 
any  more  valid  than  that  of  the  advanced  student? 

5)  Is  the  accuracy  of  the  prediction  from  the  clinical 
judgment  increased  by  adding  the  Individual  record  form  and 
the  autobiography  to  the  battery  of  tests  considered? 


MATERIAL  HDURE 

Entering  freshmen  at  Kansas  State  College  are  given  a 
battery  of  tests  designed  to  give  i     ation  about  what  sort 
of  person  the  individual  is,  how  well  he  is  able  to  learn, 
what  his  interests  are,  and  what  his  level  of  achievement  is 
in  certain  areas.  This  is  done  through  the  Counseling  Bureau, 
and  scores  are  available  to  counselors  and  faculty  advisers 
for  use  in  whatever  manner  is  most  valuable  to  the  student. 
The  battery  consists  of  the  American  Council  on  Education 
Psychological  Examination,  both  the  American  Council  on  Ed- 
ucation English  Test  fend  Reading  Comprehension  Test,  the  Minn- 
esota Personality  Gcale,  and  the  Strong's  Vocational  Interest 
Blank.   Engineering  students  take  the  Revised  Minnesota  Paper 
Form  Board  and  the  Cooperative  Mathematics  Test.   In  addition, 
each  freshman  fills  out  an  Individual  Record  Form  and  writes 
a  short  autobiographical  sketch.   Since  the  scores  on  these 
tests  of  freshmen  entering  Kansas  State  in  the  fall  of  1948 
are  vital  to  this  study,  a  brief  description  of  each  test 
follows. 

The  avowed  purpose  of     American  Council  on  Education 
Psychological  Examination  (15)  is  to  appraise  what  has  been 
called  scholastic  aptitude  or  learnii:;  ability,  with  specific 
reference  to  the  requirements  of  most  college  curricula. 
Three  scores  are  given.   The  "Q"  or  quantitative  test  score 


Is  the  sum  of  the  number  of  an:      the  individual  has  correct 
on  the  sub-tests:  arithmetical  reasoning*  number  series,  and 
figure  analogies.  The  quantitative  group  is  designed  to 
measure  abilities  necessary  in  technical  vocations  such  as 
en.  ineering.   The  "L"  or  linguistic  test  score  includes  the 
same-opposite  test,  the  completion  test,  and  verbal  analogies 
test.   The  linguistic  scores  are  designed  to  measure  those 
abilities  which  are  necessary  in  work  involving  the  manipula- 
tion of  verbal  material.   The  third  score  is  the  total  of  the 
nQ"  and  ML"  scores.   These  scores  are  converted  into  percen- 
tile ranks  to  compare  the  student  with  his  classmates.   Any 
wide  discrepancy  between  the  "Q"  an   "L"  scores  is  thought  by 
•om«  to  be  Indicative  of  an  emotional  disturbance. 

The  Cooperative  Achievement  Test  (8)  for  English  consists 
of  three  parts:  English  usage,  spelling,  and  vocabulary.   This 
test  is  useful  for  selection  of  individuals  with  the  highest 
scores,  placements  In  groups  on  the  basis  of  their  standing, 
or  for  aid  in  individual  guidance.   The  same  features  are  true 
for  the  Cooperative  Reading  Comprehension  Test;  reading  speed 
and  level  of  comprehension  are  measured. 

The  Minnesota  Personality  Scale  (11)  yields  scores  on 
areas  of  personal  adjustment  designated  as  morale,  social 
adjustment,  family  adjustment,  emotional  adjustment  an  .  economic 
conservatism.   The  first  four  are  considered  to  be  the  most 
useful.   A  low  score  on  the  moralo  3cale  indicates  the  student 
is  not  very  ha:  py  in  his  outlook  for  the  future.   It  might  be 


an  evidence  of  depression.  A  high  score  indicates  optimism. 
Social  ad ju3 tment  relates  to  social  sure-footedness.   Low 
scores  indicate  a  lack  of  self-confidence  in  social  situa- 
tions. High  scores  indicate  ease  and  poise  in  social  situa- 
tions.  The  family  adjustment  key  is  probably  the  most  im- 
portant scale  on  the  test.   Poor  family  adjustment  is  Indi- 
cated by  low  percentile  rank,  and  Is  usually  a  handicap  to 
an  individual.   Poor  home  adjustment  Is  usually  accompanied  by 
other  problems  of  a  psychological  nature.   Low  scores  on  the 
emotionality  key  indicate  an  unstable  personality.  Average 
to  high  scores  indicate  a  stable  personality.   Extremely  low 
scores  on  these  tests  are  symptomatic  of  maladjustment,  and 
counseling  Is  usually  indicated. 

The  Strong's  Vocational  Interest  Blank  (11)  Is  exactly 
what  the  name  implies,  and  is  not  ono  of  intelligence,  school 
achievement,  or  special  aptitude.   It  measures  the  extent  to 
which  one's  interests  agree  or  disagree  with  those  of  suc- 
cessful men  in  given  occupations,  and  it  is  possible  with  a 
fair  degree  of  accuracy  to  predict  by  this  test  whether  or 
not  one  would  be  satisfied  in  certain  occupations.   The  test 
is  most  useful  if  a  score  is  computed  for  each  of  the  Individ- 
ual occupations  on  which  the  test  was  standardized.   Hov/evo  , 
complete  scoring  Is  a  very  difficult  and  tl-.e-consumi' 
process,  and  unless  it  is  especially  requested  the  tests  are 
scored  only  for  groups  of  occupations  determined  by  factor 
analysis.   The  following  list  shows  the  occupational  groups 


which  are  scored!  Artistlc-Medlcd,  Fnglnecr*  Agricultural- 
Technical*  Social  Service*  Business  install*  Sales *  and 
Writers  and  Lawyers.  The  occupatlo.no  included  In  the  respec- 
tive groups  all  correlate  highly  with  one  another*      ants 
have  been  given  letter  ratings  on  each  of  seven  group  soalos. 
Occupations  in  groups  rated  A  &r         -  lus  should  be  carefully 
considered  before  definitely  decld:     ainst  them;  occu- 
pations in  groups  rated  C»  C-plus*  and  B-rainus  s:     be 
earefully  considered  before  definitely  decidlr     enter  theeu 
There  are  also  three  non-occupational  keys  which  give  a  bettor 
understanding  of  a  student1 s  interest  pattern.  The  OL  scale 
refers  to  "occupational  level"  an  1  gives  scores  on  a  conti- 
nuum* Indicating  whether  one's  interests  are  similar  to  un- 
skilled workmen  (a  low  score)  or  to  business  and  professional 
men  (a  high  score).  The  KP  or  masculinity-femininity  scale 
indioates  whether  one's  interests  are  similar  to  the  interests 
of  women  or  men*  and  in  general  reflects  how  verbal  one's 
interests  are.  The  IB  scale  expresses  maturity  of  interests. 
This  score  differentiates  betweon  interests  characteristic 
of  children  and  young  people  and  those  of  adults.  A  low  score 
Is  an  indication  of  interest  Immaturity*  and  may  reflect  In- 
ability to  take  responsibility*  restlessness *  immature  atti- 
tudes* and  enjoyment  of  activity.  One's  age  must  be  taken 
into  consideration  in  interpreting  the  IM  score*  arid  is  gen- 
erally not  used  if  a  student  Is  over  25  years  of  a  o.  Many 
advisers  and  counselors  feci  that  the  little  autobiogr    sal 
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sketch  written  as  the  English  place,  Bent  theme  gives  a  quick 
insight  into  the  "individual  as  a  whole,"  and  helps  in  inter- 
preting the  rest  of  the  data  in  the  folder.   In  this  sketch, 
the  freshman  relates  the  high  spot3  and  low  spots  In  his 
career,  which  usually  gives  some  deep  insights  into  the  kind 
of  person  he  is  and  why  he  is  that  sort  of  person. 

The  Individual  Record  Font  also  gives  much  information 
to  supplement  this.   Besides  the  identifying  data,  It  In- 
cludes information  about  his  family,  hi3  high  school  exper- 
iences, his  work  experiences,  his  leisure  time  preferences, 
his  plans  and  goals  for  the  future,  his  health,  and  his  con- 
cept of  himself  and  his  problems. 

A  sampling  was  made  taking  one  out  of  every  five  of  the 
freshmen  of  1948  who  took  the  battery  of  tests,  making  a  total 
of  257  students.  Ten  of  these  were  eliminated  from  the  saiple 
because  of  Incomplete  information. 

Four  counselors  and  four  advanced  students  utilized  this 
battery  of  tests  in  making  predictions.  They  were  selected 
for  their  varying  educational  qualifications  and  experience  in 
the  hope  that  more  might  be  learned  as  to  what  influence,  if 
any,  trainli      experience  have  on  the  validity  of  judgments. 
Since  the  counselors  and  students  used  as  judges  are  import- 
ant variables,  a  brief  sketch  of  the  training  and  experience 
of  each  will  be  given. 

Counselor  Number  One  is  33  years  of  age,  has  completed 
96  hours  of  psychology  and  education,  73  of  them  being  graduate 
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credit.   He  has  also  completed  the  course  and  resident  re- 
quirements for  the  Ph.  D.  degree.  His  practical  experience 
includes  seven  years  of  high  school  and  junior  college  teach- 
ing, counseling,  and  administration;  one  year  of  psychoid 
ical  work  in  the  array;  and  four  years  counseling  in  a  college 
counselin  situation. 

Counselor  Number  Two  is  29  years  of  age,  is  a  candidate 
for  the  I  .   .  degree,  and  has  completed  57  hours  of  educa- 
tion and  psychology.   He  worked  nearly  two  years  in  the  vet- 
erans' service  dc_     ent  of  the  State  Board  of  Social  Wel- 
fare, an  I  has  worked  in  a  college  counseling  bureau  for  two 
and  a  half  years.   He  has  tended  to  specialize  in  vocational 
and  educational  advisenent  during  this  time. 

Counselor  Number  Three  is  27  years  ol      ha3  completed 
course  and  residence  requirements  for  his  doctorate.   He  has 
92  hours  in  the  field  of  psychology  and  education.   His  work 
experience  includes  two  years  of  college  teaching,  mainly 
dealing  with  group  work;  one  semester  in  Personnel,  one  year 
teaching  psychology,  and  one  year  in  a  college  counseling 
situation. 

Counselor  Number  Four  is  24  years  of  age,  has  50  hours 
of  psychology  and  education.       orked  in  a  child  guidance 
clinic  for  one  year,  was  practicum  supervisor  of  graduate 
students  for  two  years,  ft&  has  been  clinical  counselor  in  a 
college  counseling  situation  for  one  year.   Her  training  and 
experience  have  emphasized  clinical  procedures,  projective 
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techniques,  etc. 

None  of  tho  advanced  t  its  has  received  any  practical 

experience.   Student  Number  One  is  21  years  of  ■     ill  re- 
ceive her  B.  S.  degree  in  the  spring  of  1950,  and  has  32 
hours  of  undergraduate  credit  in  the  fields  of  education  and 
psychology.   Stude        r  Two  is  24  years  of  age.   He  i3  a 
candidate  for  t      ree  Master  of  science  and  has  completed 
48  hours  of  education  a;d  psychology.  Student  Number  Three 
is  23  years  of  age,  has  49  hour .3  of  education  and  psychology 
and  is  a  candidate  for  his   ■   .   .  r-c;.   student  Number  lour 
i3  21  years  of  age,  will  receive  her  B.  S.  degree  in  the 
spring  of  1950  and  at  present  is  completing  these  require- 
ments as  well  as  doing  graduate  work,  she  has  completed  48 
hours  of  education  and  psychology. 

These  eight  counselor      students  made  predictions  on 
each  of  the  247  students  in  the  sample.   Clinical  Judgments 
v/ere  given  as  to  the  most  probable  grade  and  the  next  two  most 
probable  grades  for  the  freshman  year,  whether  or  not  the 
student  would  survive  the  freshman  year,  and  whether  or  not 
the  student  would  change  his  curriculum  during  that  time. 
For  half  of  the  students,  the  above  mentioned  battery  of  tests 
was  the  basis  for  prediction.   For  the  remaining  half  the 
Individual  Record  Form  and  the  autobiographical  sketch  were 
eliminated  from  the  available  data.   This  was  done  with  the 
purpose  in  mind  of  ascertaining  the  effect  that  the  inclusion 
of  these  two  will  have  on  the  validity  of  the  judgments. 
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Tho  criteria  for  ascertaining  the  accuracy  of  the  juo  - 
ments  of  tlie  counselors  and  students  and  the  statistical 
predictions  are  all  information  obtained  from  the  Registrar^ 
Office  at  Kansas  ;  tate  College.  They  include  the  grade  point 
average  of  the  student  for  the  freshman  year*  any  changes  of 
curriculum  which  may  have  occurred,  and  the  list  of  students 
who  withdrew  or  were  dismissed  during  the  school  year  of 
1940-49  or  did  not  return  to  Kansas  State  for  the  fall  semes- 
tor  of  1949. 

As  tho  data  v=ere  received  they  were  coded  and  recorded 
on  I.IcBee  Keysort  cards.  There  is  an  individual  car    ■  each 
student  containing  the  following  information:  name,  sex, 
actual  ,  rade  point  avare     i^ade  point  averages  predicted  by 

I   counselors  and  advanced  students,  use  of  personal 
documents,  American  Council  on  Education  Psychological  Exami- 
nation score,  actual  change  of  curricula,  whether  the  student 
survived,  prediction  by  the  counselors  and  students  as  to  the 
change,  prediction  by     counselors  and  students  as  to  sur- 
vival, whether  or  not  the  student  was  on  probation  during  the 
school  year,  and  whether  or  not  he  returned  in  the  fall  of 
1949.  These  cards  were  used  to  facilitate  the  more  rapid  and 
accurate  handling  of  tho  statistical  data* 

Product  moment  coefficients  of  correlation  were  then  e 
puted  between  actual  grade  point  average  and  (1)  standing  on 

American  Council  on  Education  Psychological  Examination 
and  (2)  the  predictions  of  each  of  tha  counselors  an d  each  of 
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the  students.   Predictions  were  ordered  as  follows:   A-B-C 
(A  is  the  most  probable  grade,  B  is  the  next  most  likely,  and 
C  is  next  most  likely),  B-A-C,  B-C-A,  B-C-D,  C-B-A,  C-B-D, 
C-D-B,  C-D-P,  D-C-B,  D-C-F,  D-F-C,  and  F-D-C. 

In  addition  to  computing  these  coefficients  for  the  total 
group,  correlations  were  made  on  the  following  subdivisions: 
women  for  whom  no  personal  documents  had  been  used  in  making 
the  predictions,  women  for  whom  personal  documents  were  used, 
men  for  whom  the  documents  were  not  used,  and  men  for  whom 
they  were  used.   These  were  done  for  all  predictions  made  by 
the  counselors  and  students. 

Percentages  of  agreement  of  prediction  as  to  curriculum 
changes  were  computed  for  each  counselor  and  student,  as  well 
as  for  the  Strong's  Vocational  Interest  Blank.   These  were 
also  computed  according  to  sex  and  the  use  of  personal  docu- 
ments.  It  was  assumed  that  those  ranking  lower  than  a  B-minus 
on  tho  Strong's  Vocational  Interest  Blank  would  not  remain  in 
the  curriculum  in  which  they  were  enrolled.  The  difference 
and  critical  ratio  were  computed  for  predictions  as  to  cur- 
riculum changes  with  and  without  the  use  of  personal  documents, 
for  the  percentages  of  agreement  between  the  predictions  of 
the  counselors  and  students,  and  for  the  percentages  of  agree- 
ment of  the  statistical  predictions  and  clinical  judgments. 

Percentages  of  agreement  of  prediction  as  to  whether  or 
not  the  student  would  survive  the  freshman  year  were  also 
computed  for  each  counselor  and  student.   Two  cutting  points 
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were  used  to  determine  which  students  would  be  expected  to 
fail  or  drop  out  according  to  tho  American  Council  on  Educa- 
tion Psychological  Examination.   Percentages  wero  computed 
us'     reement  of  the  group  which  ranked  in  the  lowest  10 
percent  and  those  who  ranked  in  the  lowest  20  percent.  These 
were  divided  into  separate  groups  of  men  with  and  without 
personal  documents  and  women  vith  and  without  the  documents. 
The  difference  and  critical  ratio  were  computed  for  predic- 
tions as  to  survival,  with  and  without  personal  document 
for  men  and  women;  for  the  percentages  of  agreement  betw; 
the  predictions  of  the  counselors  and  students;  and  for  per- 
centages of  agreement  between  the  statistical  predictions  and 
the  clinical  Judgment.   here  the  1  :vel  of  confidence  appeared 
to  be  significant,  it  was  included. 

A  EEVTF        ,ATED  LITERATURE 

While  there  have  been  no  studies  which  investigate  pre- 
cisely the  same  problems  undertaken  here,  the  need  has  been 
so  greatly  felt  that  a  number  of  similar  studies  have  been 
made  by  researchers  in  the  field  at  colleges  and  universities 
throughout  the  country. 

One  such  study  was  done  by  F.  G.  Livingood  (14).  His 
hypothesis  was  that  "a  battery  of  stn  'ardized  tests  admini  - 
tered  to  freshmen  with  a  derived  aptitude  index  can  serve  ef- 
fectively to  indicate  probable  scholastic  achievement  in  col- 
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le  ,  articular ly  durin         >  two        i  the  college 
pro      '  Two  hundred  a  ,he 

Liberal  Arts  Col  tests  iriclu 

two  psychological  tests,  on     iing  tost,  ,tics, 

ono  English,  one  la.     )  aptitude,  on     _al  studies,  and 
eat.  An     bude  index  wa3  work  i  the 

last  five  of  these.  The  scholastic  index  wi  „'s 

achievement  d  .   Correlation 

>nts  were  then  computed  with  the  folic     resul 
index  with  the  freshman  cumulative  index,  .67;  t 
freshma:  cumulative  h  ith  the  secondary- school  lnda 

.63;  the  fr       /umulative  index  with  the  average  of  the 
two  psychological  examinations,  .37.   The  conclusion  reached 

that  50  percent  of  the  fre    .  .  scholarship  indexes  o 
be  predicted  within  plu3  or  minuji  .5  of  an  index  point.  The 
correlation  scer:s  to  be  best  for  the  freshman  year,  an  less 
in  the  junior     senior  years. 

avid  F.  Votaw  (23)  made  use  of  three  tests:  the  American 
Council  on  /etiological  a,  The  Coopera- 

tive English  /.chievomont  Test,  and  the  Use  of  Library  and  Study 

tcrials  Test.   Scores  on  those  ti     cw   converted  into  T 
scores  t     bstituted  into  a  formula  from  which  an  estimate 

of  the  student's  expected  scholastic  grade 
point  averarc.   The  probable  error  of  such  an  estimate  was 
found  to  be  .42.   The  correlation  of  the  actual  grade  point 
average  with  the  weighted  combined  scores  of  the  three  tests 
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was  found  to  be  a  plus  .61,  this  being  higher  than  the  corre- 
lation of  any  one  of  the  three  tests  with  grade  point  averages. 

The  American  Council  on  Education  Psychological  Examina- 
tion alone  was  used  by  IV.  L.  Wallace  as  a  basis  for  research 
(23).  Freshmen  who  enrolled  in  the  fall  of  1947  at  the  Uni- 
versity of  Michigan  were  given  the  ACE  Psychological  Examina- 
tion. The  majority  of  them  were  from  the  Colleges  of  Litera- 
ture, Science,  and  the  Arts  with  a  few  from  Pharmacy,  Music, 
and  Architecture.  No  on; ineers  were  included  in  the  study. 
Actual  grades  in  the  18  largest  and  most  usual  courses  of  the 
first  semester  were  compared  with  the  test  scores  of  students 
taking  them.   Simple  correlations  were  computed  between  the 
course  grades  and  each  of  the  three  scores  on  the  1947  Form  of 
the  ACE.   In  addition,  multiple  correlations  were  calculated 
between  grades  and  the  combination  of  the  Q  and  L  part  scores. 
Several  conclusions  were  reached.  Seemingly,  correlations 
were  small  between  the  scores  on  the  ACE  and  grades  in  courses. 
The  greatest  relationship  wa3  established  between  the  English 
grades  an.;  the  total  score  on  the  ACE.  The  correlation  coef- 
ficient here  was  .49,  leaving  much  to  be  desired  since  only 
24  percent  of  the  variation  in  grades  in  that  course  was  ac- 
counted for  in  the  ACE  scores.   Correlations  with  other  courses 
were  even  le33.   Correlations  seemed  to  be  highest  with  the 
first  semester  grades,  decreasing  with  succeeding  levels.   Due 
to  the  smallness  of  tho  relationship  between  the  results  of 
this  test  and  achievement  as  measured  by  the  first  year  college 
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•ades,  one  may  assume  that  an  individual  obtaining  a  low 
3Core  on  the  ACE  may  profitably  engage  in  college  work  if 
other  indications  are  in  his  favor.   Since  there  is  also  such 
a  slight  differential  in  the  early  predictive  value  between 
the  Q  and  L  scores,  considerable  caution  should  be  used  in  the 
interpretation  of  the  Q  and  L  differential  for  purposes  of 
educational  guidance.   Howevor,  he  concludes  that  the  Ameri- 
can Council  on  Education  Psychological  Examination  remains 
one  of  the  best  single  predictors  of  academic  success  in  higher 
education. 

Theodore  A.  Sarbin  (17)  set  out  to  disprove  the  hypothe- 
sis that  "By  virtue  of  the  case  study  method  employed,  clin- 
ical counselors'  predictions  will  be  more  accurate  than  those 
determined  from  regression  equations."  The  research  was  done 
at  the  University  of  Minnesota,  and  predictions  were  made  on 
162  freshmen,  73  men  and  89  women  who  enrolled  in  the  arts 
college  in  1939.   The  data  available  to  the  counselors  were 
the  measurement  variables,  additional  tests  of  aptitude, 
achievement,  vocational  interest  and  personality,  the  individ- 
ual record  form,  preliminary  interviewer's  form,  and  impres- 
sions from  the  counselor's  own  observations.   The  predictions 
were  made  by  five  clinical  counselors  on  the  eight  point  scale 
and  correlated  with  actual  honor  point  ratios  at  the  end  of 
the  quarter.   The  statistical  prediction  was  made  by  substitut- 
ing the  values  of  two  variables,  high  school  rank  and  college 
aptitude  test  score,  in  a  previously  derived  regression 
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equation  and  solving  for  the  most  probable  honor  point  ratio. 
The  coefficient  of  correlation  between  the  actual  honor  point 
ratios  and  clinical  and  statistical  predictions  were  as  fol- 
lows: 

Type  of  prediction        Men       

Clinical  .35        .69 

Statistical  .45        .70 

The  following  conclusions  were  reached  by  Dr.  Sarbin  (17): 

1. )  Statistical  predictions  are  more  accurate 
t.  an  clinical  predictions  if  the  same  trend  con- 
tinues. 

2.)  Factors  such  as  interest,  inferred  level  of 
aspiration,  and  personality  traits,  as  measured  in 
this  experiment,  appear  nob  fco  be  related  to  achieve- 
ment in  college.   Furthermore,  clinical  interviewers 
do  not  U3e  these  measures  systematically,  so  that 
actually  they  give  little  or  no  weight  to  them  in 
making  predictions. 

3.)  In  formulating  predictions,  counselors  seem 
to  rely  for  the  most  part  on  rank  in  high  school  grad- 
uating class  and  college  aptitude  test  results.   These 
are  the  same  variables  which  are  found  in  the  regression 
equations. 

4.)  This  leads  us  to  the  conclusion  that  as  a  com- 
plement to  actuarial  predictions,  the  clinical  predic- 
tions add  nothii:  . 

5.)  When  cast  in  tho  form  of  success-failure  in- 
stead of  the  eight  interval  scale,  clinical  predictions 
are  shown  to  be  no  more  valid  than  the  more  easily  ob- 
tained statistical  predictions. 

6.)  The  reliability  of  clinical  predictions  by  the 
interviewers  and  case  readers  varies  from  .64  to  .88. 
The  predictions  made  by  the  same  case  reader  six  months 
apart  correlated  to  .78. 

7.)  Clinical  predictions  overestimate  the  criterion 
by  about  one-third  of  a  letter  grade.   Statistical  pre- 
dictions overestimate  by  no  significant  amount. 
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Sarbin  sums  up  his  study  as  follows: 

Any  jury  sitting  in  j     it  on  the  case  of  the 
clinical  versus  the  actuarial  methods  must  on  the  basis 
of  efficiency  and  ec     declare  overwhelmingly  in  favor 
of  the  statistical  method  for  predicting  academic  achieve- 
ment.  Even  though  the  small  differences  which  uniformly 
favor  the  actuarial  method  are  not  statistically  reliable, 
the  factor  of  time  and  efficiency  will  decide  in  favor 
of  the  regression  equation  with  its  known  margin  of 
error. 

A  study  which  may  be  briefly  reviewed  is  that  of  Kenneth 
.  Freeman  at  Christian  College  (12).   Over  a  four  year 
period  the  actua3.  marks  of  1000  first  year  students  were  com- 
pared with  the  most  probable  grade  point  average  as  obtained 
from  a  regression  equation  utilizing  scores  from  the  Otis 
Self -Administering  Testu  of  Mental  Ability  and  the  Iowa 
Placement  Test  in  English  Traini;  .   .iixty-nlno  and  one-tenth 
percent  of  %he   cases  had  a  standard  error  of  zero  to  one 
standard  deviation.  I     :hic  he  concluded  that  for  those 
who  believe  that  academic  success  is  a  prerequisite  to  a  happy 
and  successful  college  experience,  this  procedure  may  provide 
a  solution.   It  has  been  used  successfully  to  identify  those 
students  whose  lack  of  academic  proficiency  points  to  the 
probability  of  an  unprofitable  experience  in  a  specific  col- 
•  or  university. 

At  the  University  of  Chicago,  A.  L.  Assum  and  s.  J.  Levy 
made  a  study  of  ability  and  achievement  of  both  presumably 
adjusted  and  maladjusted  students  using  71  of  each  group  (3). 
These  data  included  five  ratings  of  scholastic  aptitude  which 
are  given  to  entering  students:  the  ACE  Q  score,  the  ACE  L 
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score,  the  ACT.   T  score,  the  College  Reading  Ability  Scor 
and  the  College  Writing  Ability  "core.  Additional  criteria 
were  grades  and  the  college  comprehensive  examination  scores. 
The  results  were  that  the  maladjusted  roup  compares  in 
academic  ability  to  the  adjusted  rroup,  but  that  there  is  a 
difference  in  favor  of  the  adjusted  group  in  regard  to  academ- 
ic achievement. 

A  comprehensive  study  entitled  Predictli:,   -..  c  .-   in 
Professional  Schools  has  be     le  by  Dewey  B.  Stuit,  Gwen- 
dolen 3.  Dickson,  Thomas  F.  Jordan,  an  I  Letter  Schloerb,  mem- 
bers of  a  subcommittee  of  the  Committee  on  Student  Personnel 
Work  of  the  American  Council  on  Education  (21).   This  group 
has  combined  into  one  book  the  bases  for  predicting  success 
in  engineering  training,  law  training,  training  for  medicine, 
training  for  dentistry,  the  study  of  music,  agricultural 
training,  teacher  training,  and  in  nursing  schools,   while  it 
is  impossible  to  go  into  the  details  of  each  of  these  bases, 
3one  of  th.;  basic  assumptions  may  be  listed.   Speaking  of  the 
prediction  problem  in  general,  they  foal  that  "perfect  effi- 
ciency is  not  possible,  but  it  13  feasible  to  speak  concerning 
an  individual's  chances  of  reaching  a  specified  level  of 
achievement  or  adjustment.   In  general,  one  can  say  that  the 
chances  of  success  are  good  for  a  high-ranking  student  n 
poor  for  the  low-ranking  student."  Two  prediction  factors 
are  taken  into  consideration:  the  personal  factor,  which  in- 
cludes all  of  the  traits  or  characteristics  that  pertain  to  a 
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person,  the  result  of  native     environmental  factors; 

and  situational  factors,  Including  all  those  influences  which 
are  independent  of  the  individual  and  external  to  him.   It  If 
stated  that  one  often  falls      ke  into  account  the  situa- 
tional factors.   The  predictive  indexes  Include  personal  his- 
tory data,  previous  educational  records,  scholastic  aptitude 
tests,  scholastic  achievement  tests,  special  aptitude  tests, 
personality  and  interest  factors,  and  a  combination  of  pre- 
dictive factors.   In  these  studies,  the  predictive  value 
combinations  of  measures  i3  almost  always  described  in  ter.  s 
of  the  multiple  correlation  coefficient  since  the  predictive 
value  of  clinical  judgments,  as  used  in  counseling*  has  simply 
not  been  reported  extensively  In  literatur 

A  very  brief  study  is  reported  b  J.  Cronbach  in  hi3 
Essentials  ~.  .penological  Testing  (7).  lien  in  the  Navy  who 
were  sent  to  electricians'  mate  school  were  givon  two  tests — 

■strical  Knowledge  and  Arithmetical  Reasoning.   These  two 
tests  correlated  to  »50  with  success  in  training.   Trained 
enlisted  classiflcatic     eialists  Interviewed  each  man,  hav- 
ing available  his  tost  scores,  a  life  history,  and  other  data* 
Based  on  test  scores  and  judgments,  the  interviewers'  rating 
correlated  only  .41  with  success.   In  other  words,  judgments 
departing  from  the  test  recommendation  reduced  the  correctness 
of  prediction.  This  finding  was  confirmed  in  Air  Force  re- 
search. The  conclusions  were  that  personnel  workers  must  be 
extremely  competent,  and  that  there  seem  to  be  better  predic- 
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tions  by  the  multiple  correlation 

In  a  bibliography,  Earl-  E.   maul  lists  the  follow!, 
conclusions  reached  by  authorities  in  the  field  (10): 

(V.'agner)  Prediction  based  on  high  sc1  -nance  as 

•isured  by  the  average  on  the  New  York  State  Regents'  Ex*  - 
ination  la  the  best  i      criterion  at  the  University  of 
Buffalo . 

(Paul)  Students  v;ith  hig     res  on  the  pi:     at  tests 
tend  t     ain  in  school  lo:  hours  of  credit, 

I  fail  in  fewer  courses. 

(Hildroth)  If  a  student  la         ..nally  he  tend3  to 
remain  1  low,  prediction  of  his  ultimate 

st,  certain. 

son  ai    bo* ley)  ]       11  only  predict  perfect- 
ly if  and  \        necessary  conditions  are  present  in  the 
student.   It  is  conceded  then  that  the  test  has  greater  si^- 
nific     when  combined  with  other  personal  factors. 

issell)  Succei.     end3  more  on  certain  factors; 
1 ration,  physical  and  mental  health,  personality  and  social 
relations  of  the  student  with  parents  as  veil  as  fellow 
students  and  faculty,  on  the  degree  for  which  home  and  school 
have  prepared  students  for  individual  living  and  3elf -direction, 
than  on  marks  and  tests. 

(Leaf)  Two  regression  equations  predict  the  aver, 
college  marks  of  tJ      dents  within  .44  and  .40  of  a  letter 
mark . 
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Emme  concludes  that  there  is  much  evidence  that  high 
school  performance  or  rar     the  host  si     criterion  for 
prediction.   Other  factors  ar;  ;,  coll     arks, 

test3  of  all  kinds,  interest  and  enjoyment,  and  personality 
traits  and  characteristic  i«   pie  predictive  method  is  con- 
sidered the  beat  method  of  all     o  it  embrace!  several  fac- 
tors. 

All  of  the  studies  reported  on,  while  exceedingly  val- 
uable, are  30  contradictory  that  no  doubt  romains  concerning 
the  need  for  continued  research  on  the  most  effective  methods 
of  prediction. 

The  product  moment  coefficients  of  correlation  between 
the  actual  grade  point  average  and  the  predictions  as  to  the 
nos '     'able  grade  are  given  in  Table  1. 

For  the  total  sample  group  the  correlation  coefficient  of 
the  American  Council  0     cation  Psychol     1  Examination 
with  the  actual  grade  point  average  is  .416.  The  c:       its 
for  the  counselors'  predictions  vary  from  .460  to  #527  and  for 
the  students'  predictions  from  .408  to  .473.   It  can  be  seen 
that  all  of  the  coefficients  of  the  predictions  with  the  ex- 
ception of  that  of  one  student's  are  superior  to  the  statisti- 
cal predictio  scores  made  on  the  AC1 
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Table  1.   Correlations  of  ^rade  point  average  with  predic- 
tions. 


Soe 

tflclent 

f  p'  ■ 

Measure    : 

Ken 

• 
• 

1  . 

0  or:       : 

Total 

-,..., 

« 
* 

: 

:   PD   : 

ACE 

i 

359 

.574 

.416 

Counselor  One 

.408 

.565 

.470 

.582 

.527 

Counselor  Two 

.449 

.500 

.302 

.551 

.510 

Counselor  Three 

.37' 

(.39 

.562 

(.492)* 

.509 

Counselor  Four 

.  '54 

.546 

.316 

■  189 

.450 

Student  One 

.330 

.439 

.301 

75 

.408 

Student  Two 

.421 

.506 

.134 

.484 

.473 

Student  Three 

.299 

.434 

.272 

.601 

.  '17 

Student  Four 

.340 

.4' 

.337 

.520 

.432 

Did  not  use  personal  documents 


Further  breakdown  of  tho  chart  gives  additional  informa- 
tion as  to  the  most  effective  method  of  predicting  grade 
point  averages.  Wide  variations  occur  between  the  correla- 
tion coefficients  when  the  personal  documents  were  used  for 
predicting  and  when  they  were  not.   Smaller  individual  varia- 
tions occur  depending  upon  the  sex  of  the  individuals  whose 
,  rades  are  bein^  predicted.   For  th«  counselors  these  were 
between  .354  and  .449  for  the  men  when  no  personal  documents 
wore  used.  When  parsonal  documents  were  used  the  variation 
was  from  .500  to  .565.   Variations  of  the  coefficients  for  the 
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predictions  c  rades  were  from  .302  to  .562  when  no 

personal  documents        id,        I  .551  to  .689  when  per- 
sonal documents  were  \      Although  a  coef- 
ficients have  been  figured  separately  for  Counselor  number 
Three,  this  counselor  did  not  use  personal  documents  for  his 
prediction 

.its,  the  predictions  on  men  with  no  perse 
documents  r<  .299  to  .421,  and  for  men  with  persunal 

documents  they  wore  .434  to  .506.   For  the  women  with  no  per- 
sonal documents  they  ranged  from  .134  to  .337  and  with  per- 
sonal documents  the  correlations  were  from  .475  to  .601.   The 
group  consisting  of  women  with  no  personal  document      con- 
siderably smaller  than  the  other  groups  with  the  result  that 
a  few  incorrect  predictions  by  Student  Number  Two  caused  hia 
extremely  low  coefficient  of  correlation. 

»r  all  counselors  and  students,  predictions  made  with 
the  use  of  personal  documents  had  higher  coefficients  of  cor- 
relation with  the  actual  grade  point  averages  than  did  those 
made      ;t  the  personal  documents.   For  the  most  part,  the 
counselors  had  higher  correlation  coefficients  of  predictions 
than  did  the  students. 

en  the  breakdown  was  made  for  men  and  women  on  the 
statistical  predictions  of  the  American  Council  on  Education 
Psychological  Examination,  the  product  moment  coef.     at  of 
correlation  for  men  with  the  actual  grade  point  average  was 
.369  and  for  women  was  .574.   This  discrepancy  between  the 


predictability  of  men  and  women  was  borne  out  in  other  results 
mentioned  throughout  this  study. 

Table  2  shows  the  percentages  of  agreement  for  predicted 
change  of  curriculum  with  the  actual  change  of  curriculum. 
The  statistical  prediction  was  based  on  data  from  the  Stron 
Vocational  Interest  Blank,  and  the  eight  counselors  and  stu- 
dents made  their  predictions  using  personal  documents  on  half 
of  the  group  and  without  their  use  for  the  other  half. 

Table  2.   Percentage  of  agreement  for  predicted  change  of 
curriculum  with  actual  change  of  curriculum. 


Percenta 

ge  c  ;" 

agreement 

Criterion    : 

en     : 

Total 

NPD 

:  PD  : 

WPb 

:  PD   : 

Strong's  Vocational 
Interest  Blank 
(B-minus  or  less) 

71.3 

68.7 

50.0 

53.7 

66.5 

Counselor  One 

92.1 

85.5 

95.5 

85.4 

89.0 

Counselor  Two 

75.2 

71.1 

90.9 

80.5 

76.1 

Counselor  Three 

82.4 

69.8 

83.3 

80.8 

78.0 

Counselor  Four 

60.0 

57.5 

80.0 

66.7 

62.0 

Student  One 

65.3 

61.4 

72.7 

63.4 

64.4 

Student  Two 

80.2 

83.1 

95.5 

80.5 

82.6 

Student  Three 

85.1 

77.1 

95.5 

75.6 

81.8 

Student  Pour 

77.2 

53.0 

68.2 

53.7 

64.4 

25 
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Following  procedures  already  described,  the  percentages 
computed  from  the  predictions  of  the  Strong's  Vocational  In- 
terest Blank  are:  for  nen  in  tho  group  with  which  personal 
documents  were  used,  68.7  percent;  for  men  in  the  group  where 
they  were  not  used,  71.3  percent;  for  women  with  personal 
documents,  53*7  percent;  and  for  women  without  personal  doc- 
uments, 50.0  percent.   This  quite  marked  difference  of  agree- 
ment between  the  predictions  for  men  and  women  does  not  seem 
to  follow  through  in  the  predictions  made  by  counselors  and 
students.   Those  made  by  the  counselors  for  men  with  personal 
documents  are  fror.  57.5  percent  to  85.5  percent  with  three  of 
the  percentages  about  69.8  percent.   For  men  without  personal 
documents  they  are  from  66.7  percent  to  85.4  percent  with 
three  of  the  percentages  above  80.5  percent.   For  women  with- 
out personal  documents  the  percentages  varied  from  66.7  to 

85.4  and  with  personal  documents  from  80.0  to  95.5. 

In  each  group  of  predictions  tho  female  counselor's  per- 
centages were  consistently  lower,  students'  percentages  of 
agreement  were  almost  consistently  lower  than  those  of  the 
counselors  with  the  exception  of  Student  Number  Two  who  is 
the  most  advanced  in  his  degree  work.  The  percentages  for  men 
with  personal  documents  were  from  53.0  to  83.1;  for  men  with- 
out the  documents  from  65.3  to  85.1.   For  women  without  per- 
sonal documents  they  ranged  from  68.2  percent  to  95.5  percent 
and  for  women  with  personal  documents  from  53. r.   orcent  to 

80.5  percent.  In  no  case  were  any  of  the  students  able  to 
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exceed  the  percentage  of  agreement  of  Counselor  Number  One 
who  has  both  the  most  experience  and  training.   It  should  be 
noted  that  the  use  of  personal  documents  does  not  appear  to 
increase  the  percentage  of  agreement  for  predicted  change  of 
curriculum  with  the  actual  change  of  curriculum,  but  rather 

9 

to  lessen  it. 

A  comparison  of  the  percentage  of  agreement  of  the  pre- 
dictions of  ti.o  counselo.,     ,h  the  percentage  of  agreement  of 
the  predictions  of  the  students  as  to  curriculum  change  is 
shown  in  Table  3.  Although  In  each  grouping,  the  percentages 
of  agreement  obtained  by  the  counselors  exceeded  those  of  the 
students,  there  is  no  narked  difference  except  for  women  with 
personal  documents.  The  difference  here  is  11.2  percent  which 
gives  a  critical  ratio  of  1.22,  not  statistically  significant. 


Table  3.   Comparison  of  percentage  of  agreement  of  predictions 
of  counselors  with  percentage  of  agreement  of 
predictions  of  students  as  to  curriculum  change. 


Group 

Counselors 

• 
• 

.   Students 

• 

> 

\      Difference 

i  ;p  :  Leal 

:  ratio 

percent 

Men  (NPD) 

79.5 

77.0 

2.5 

0.43 

Men  (PD) 

73.5 

68.7 

4.8 

0.68 

Woman  (NPD) 

89.4 

83.0 

6.4 

0.62 

V/omen  (PD) 

80.5 

68.3 

11.2 

1.22 
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Table  4  compares  the  percentages  of  agreement  of  the 
counselors  and  students  when  personal  documents  are  used  and 
when  they  are  not.   A  tendency  for  better  accuracy  of  pre- 
diction of  curriculum  changes  when  personal  documents  are  not 
used  appears  in  the  case  of  both  the  counselors'  and  students* 
predictions*  This  tendency  was  found  to  be  significant  at 
better  than  the  .10  level  of  confid    i   There  was  a  slight- 
ly greater  increase  in  accuracy  on  the  part  of  the  students 
when  personal  documents  were  not  used  than  on  the  part  of  the 
counselors. 

Table  4.   Comparison  of  percentage  of  agreement  of  predic- 
tions of  counselors  and  students  for  curriculum 
change  using  personal  documents  with  percentages 
of  agreement  of  predictions  made  without  per- 
sonal documents. 


Group 


PD 


NPD 


Difference 


percent 
84.4 

78.0 


Critical 
ratio 


Counselors     75.8 
Students       68.5 


8.6 
9.5 


1.72 

1.67 


The  percentages  of  agreement  for  the  predicted  survival 
of  the  freshman  year  with  the  actual  survival  are  shown  in 
Table  5. 

Standouts  as  far  as  high  percentages  of  agreement  for  all 
counselors  and  students  as  well  as  both  cutoff  points  on  the 
American  Council  on  Education  Psychological  Examination  are 
those  predictions  made  for  women  with  no  personal  documents. 


The  lowest  percentage  of  agreement  In  this  group  was  made  by 
a  student  and  was  72.7  percent.  Three  of  the  percentages  were 
in  the  ninth  decile,  five  were  in  the  zero  or  top  decile,  and 
Counselor  Number  One  had  100  percent  on  this  group.  Again  it 
should  be  mentioned  that  thi3  was  the  smallest  group  in  the 
entire  sample. 


Table  5.   Percentage  of  agreement  for  the  predicted  survival 
of  the  student  through  the  freshman  year  with 
the  actual  survival. 


srion   : 

Perec 

?  agreement 

Crit< 

Hen      : 

Women 

-•Total 

NPD 

1    PD 

NPD   : 

PD 

* 
• 

Lowest  10 

ACE 

percent 

63.4 

63.9 

91.0 

75.5 

68.0 

Lowest  20 
ACE 

percent 

65.3 

62.7 

91.0 

73.1 

68.0 

Counselor 

One 

85.1 

80.7 

100.0 

85.4 

85.0 

Counselor 

Two 

67.3 

61.4 

86.4 

65.9 

67.6 

Counselor 

Three 

62.7 

51.2 

91.7 

73.1 

63.6 

Counselor 

Four 

68.0 

72.5 

90.0 

66.7 

71.3 

Student  One 

62.4 

61.4 

81.8 

65.9 

64.4 

Student  Two 

66.3 

62.7 

86.4 

73.2 

68.8 

Student  Three 

63.4 

61.4 

90.9 

73.2 

67.6 

Student  Four 

59.4 

•51.8 

72.7 

63.4 

58.7 
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Using  the  students  who  ranked  in  the  lowest  ten  percent 
on  the  ACE  as  the  croup  of  potential  failures  or  drop-out3, 
the  percentage  of  agreement  for  men  with  personal  documents 
was  63.9  and  for  men  without  personal  documents  was  83.4. 
For  women  with  personal  documents,  the  percentage  was  75.5 
and  for  those  for  whom  personal  documents  were  not  used  it  was 
91.0  percent.   This  again  illustrates  the  apparent  fact  that 
it  is  easier  to  predict  for  women  than  for  men.   ComparJ 
these  percentages  with  those  occurring  when  the  students 
scoring  in  the  lowest  20  percent  are  used  as  the  criteria, 
little  difference  in  percentage  of  agreement  is  found.   The 

sliest  difference  is  0.0  percent  and  the  largest  for  an;T  of 
the  groups  is  2.4  percent. 

Counselors'  predictions  were  consistently  higher  when  no 
personal  documents  were  used,  and  the  students'  predictions 
were  in  most  cases.   Counselors'  predictions  for  men  with 
personal  documents  ranged  in  agreement  with  actual  survival 
from  51.2  percent  to  80.7  percent;  for  men  with  no  personal 
documents  from  62.7  percent  to  85.1  percent.   The  percentages 
of  agreement  for  women  were  relatively  higher  for  those  both 
with  personal  documents  and  without.   The  counselors'  predic- 
tions for  women  with  personal  documents  varied  in  agreement 
from  66.7  percent  to  85.4  percent;  for  those  without  from  86.4 
percent  to  100  percent. 

Students'  percentages  of  agreement  were  also  highest  for 
women  with  no  personal  documents.   In  that  category  they 
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ranged  from  72.7  percent  to  90.9  percent,  with  three  of  the 
percentages  being  above  81.8  percent.  For  women  without  per- 
sonal documents  the  percentages  of  agreement  varied  from  63.4 
percent  to  73.2  percent.  The  predictions  for  men  with  per- 
sonal documents  varied  from  51.8  percent  to  62.7  percent  in 
agreement  With  actual  survival  and  for  the  men  without  per- 
sonal documents  they  ranged  from  66.3  percent  to  68.0. 

In  comparing  the  percent     f  agreement  of  the  predic- 
tions of  the  counselors  with  the  percentage  of  agreement  of 
the  predictions  of  th     Jents  as  to  survival  throughout 
the  freshman  year,  thoje  of  the  counselors  were  greater  for 
both  men  and      .  -ithout  personal  documents.   This 

is  a  tendency,  but  not  a  significant  tendency  since  the  great- 
est critical  ratio,  that  for  men  with  no  personal  documents, 
is  significant  at  only  the  .15  level  of  confidence.   There  is 
a  slightly  greater  difference  between  the  percentages  of  pre- 
dictions of  students  and  counselors  for  the  men  and  women 
without  personal  documents  than  for  those  with  personal  doc- 
uments.  Critical  ratios  ranged  from  .52  for  women  with  per- 
sonal documents  to  1.49  for  men  with  no  personal  documents. 


Table  6.      Comparison  of  t  ircentagea   of  agreement  of  pre- 

dictions  of  counselors  with  percentage   of  agree* 

>nt  of  predictions   of  students  as   to   survival 
of  the  student  through  the  freshman  year. 
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Group     J 

Counselors 

'.      Students 

|   Difference 

: Critical 
:  ratio 

percc 

* 

Men  (NPD) 

72.  6 

62.9 

9.7 

1.49 

-  (PD) 

67.8 

59.3 

8.5 

1.13 

PD) 

92.4 

83.0 

9.4 

0.96 

Women  (PD) 

74.0 

68.9 

5.1 

0.52 

When  comparisons  were  made  of  the  percentage  of  agreement 
of  the  predictions  of  counselors  and  students  as  to  survival 
for  the  group  who  had  personal  documents  as  compared  with  those 
who  did  not,  no  critic.-'.  1  ratios  of  statistical  significance 
•vere  found.   For  both  counselors  and  students,  however,  the 
percentages  of  agreement  were  higher  when  personal  documents 
were  not  used,  in  the  case  of  the  counselors  the  difference 
being  2.1  percent,  ancl  the  students  4.0  percent.   This  might 
tend  to  show  that  in  the  prediction  of  survival  the  students 

;rned  t     »  more  use  of  the  personal  documents  than  did 
the  counselors. 


Table  7.  C        i  of  I     rcentages  of  agreement  of  pre- 
dictions of  counselors  and  students  for  survival 
using  personal  documents  with  percentages  of 
agreement  of  predictions  made  without  personal 
document e« 
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Critical 
ratio 


Gv 


PD 


HPD  ice 

percent 


Counselors     69.9     72.0 
Students       62.5     66.5 


2.1 

4.0 


.51 
.68 


Counselors'  and  students'  percentages  of  agreement  for 
the  prediction  of  survival  were  also  computed  according  to 
percentage  of  correct  predictions  for  men  and  percentage  of 
correct  predictions  for  women.   It  was  here  that  some  signif- 
icant differences  were  noted.   The  counselors  showed  a  dif- 
ference of  9.9  percent  more  agreement  with  actual  survival  for 
women  than  for  men.   Thi3  was  statistically  significant  at 
about  the  .15  level  of  confidence.   The  students  showed  even 
more  of  a  difference,  amounting  to  12.6  percent.   This  gave  a 
critical  ratio  of  1.89  which  is  significant  at  almost  the  .05 
level  of  confidence. 
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Table  8.  Comparison  of  percentages  of  agreement  of  counselors 
and  students  as  to  survival  throughout  the  fresh- 
nan  year  of  men  students  in  the  sample  v:ith  the 
percentage  of  women  in  the  sample  group. 


Group 


Counselors 
Students 


I»ien 


70.5 
61.3 


nen 

percent 

80.4 
73.8 


Difference 


: Critical 
:  ratio 


9.9 
12.6 


1.62 
1.89 


A  further  discussion  of  these  results  is  contained  in 
the  Interpretation  and  Summary. 

TATIOH 


Caref ul  study  needs  to  be  made  of  the  product  moment 
correlations  of  grade  point  averse©  with  predictions  as  shown 
in  Table  1.   Perhaps  the  most  obvious  of  the  conclusions  to 
be  drawn  is  the  apparent  difference  in  the  predictability  of 
men  and  women.   This  Is  vary  noticeable  in  tha  coefficients  of 
the  American  Council  on  Education  Psychological  Examination 
for  men  and  women.  The  coefficient  for  men  is  .369,  and  for 
women  It  la  .574.   This  is  carried  on  throughout  most  of  the 
coefficients  of  the  counselors'  and  students'  predictions, 
with  those  for  men  being  higher  in  only  a  few  instances. 

This  la  true  not  only  in  predictions  for  grade  point 
averages  but  for  other  predictions  as  well.   A  study  of  Table 


2  indicates  t'      r  eacL  cou:  Lent  the  por- 

cc        "  agreement  redicting  curriculum 

chance  for  women  than  when  predicting  for  men*   This,  however, 
wa      true  for  the  percenta;       reorient  of  '  s 

Vocational  Interest  Blank.   Ita  bial- 

ly      r  Tor     than  for  women,  a  point  which  will  bo  dis- 
cussed    r. 

gh  to  the  prodictio        .irvival  . 
in  Ta  rcenta  o- 

ment  arc  r  for 

true  not  only  of  the  counselors'  ar.      icnts  '  predictions, 
but  of  both  the  lowest  10  percent  en  tl     r- 

ican  Council  on   Education  Psychological  Examination,  and  the 
lowest  20  percent.   Tho  per  cent  a,  ;.es  for  the  lowest  10  percent 

;ht  be  noted  here  again  to  emphasize  this  point:  men  with 
no  personal  docu:.     ,  63.4  percent;  women  v.ith  no  personal 
documents,  91.0  percent;  men  with  personal  documents,  63.9 
percent;  and  women  with  personal  documents,  75.5  percent. 
In  Table  8  the  comparison  was  made  for  the  difference 
agreement  c     i  counselors'  end  students'  prediction: 
the  survival  of  men  and  women  through  tho  freshman  year.  The 
percentages  were  9.9  percent  higher  for  the  counselors'  pre- 
dictions on  the      's  survival  than  on  the  men's,  end  12.6 
percent  higher  for  the  students'  predictions  on  women. 

Some  re.      might  be  adva     for  the  almost  consistently 
higher  accuracy  when  predicting  for  women.   Although  women  to- 
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day  tend  to  be  breaking  away  from  the  old  stereotype — the 
"little  woman"  who  sits  quietly  at  home  with  no  interests  but 
that  of  her  family,  no  activities  but  those  of  a  wife  and 
mother,  no  personality  but  that  which  is  subdued  to  th 
around  her — this  break  is  not  yet  complete  in  most  o 
While  women  a/     Inning  to  achieve  i  i$   there  ia 

still  the  need  to  conf     r  to  fit  into  the  patterns  which 
other.        t  up  for  them.   Prom  this,  it  might  be  concluded 
tha  .,han  do  men,  whc  have  probably 

not,  as  o.   group,  felt  the  pressure  of  similar  circumstances 
toward  conformity,  and  whore  I     ore,  felt  less  constrained 
to  follow  the  accepted  pattern.   More  women  te      perform 
at  the  level  expected  of  then,  3ince  our  culture  ha3  trained 
them  to  do  so. 

Since  it  is  commonly  known  th     ay  women  are  more  ma- 
ture than  are  men  at  the  fresliraan  level,  it  v/ould  be  expected 
that  their  interest  maturity  would  be  relatively  higher  than 
that  of  men.   However,  under  the  pressure  of  circumstances 
toward  conformity  as  a  group,  it  la  probable  to  assume  that 
enthusiasm  toward  success  and  achievement  in  a  given  field 
would  be  lower  for  women.   Thus  one  would  not  expect  the 
Strong's  Vocational  Interest  Blank  to  predict  more  accurately 
for  women  than  for  men  since,  as  the  na  e  Implies ,  It  la 
inventory  cf  interests  of  the  individual  measuring  what  one 
would  like  to  do,  not  what  one's  family  or  society  as  a  whole 
expects  him  to  do.   To  many  freshman  men,  who  for  the  first 
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time  are  spatially  free  of  parental  control  and  domination, 
the  desire  to  break  away  from  the  pressures  toward  conformity 
is  froquantly  st  ires  and  th.       ovolt 

without  quite  realizi  be  more  likely  to 

follow  their  own  interests  and  shift  from  the  pattt     it  up 
by  their  families,  thus  making  them  less  prodicta  1,. 

A  different,  but  related,  explanation  of  this  phen. 
enon  has  been  advanced  by  Paul 'Torrance  who  has  demonstrated 

iMi  evaluate  themselves  more  accural      that  their 
self -concepts  are  a    realistic.   He  holds  that  since  what 
one  is  able  or  not  a  bio  to  learn  is  determined  in  a  1 

asure  by  the  way  one  h  Lne  himse      :d 

that  since  women  more  accurately  evaluate  themselves,  that  it 
necessarily  follows  that  they  may  be  expected  to  achieve  more 
nearly  as  predicted. 

Another  fact  to  be  noted  is  the  increase  in  the  accuracy 
of  grade  point  predictions  when  personal  documents  are  used 
in  making  the  predictions.   On  examining  Table  1,  it  is  appar- 
ent that  every  counselor  ai     ry  student  making  predictions 
had  higher  correlation  ooeffio       or  both  men  and  women 
when  personal  documents      u  ed,  in  most  cases  these  being 
considerably  higher.   The  question  might  be  raised  as  to  wheth- 
er  the  group  for  whom  personal  documents  were  used  was  not  an 


Paul  Torrance,  Head  of  the  Counseling  Bureau,  Kansas  State 
College,  Manhattan,  Kansas.   Unpublished  research. 
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easier  croup  to  predict.  However*  this  seems  no1       'he 
case.  Counselor     cr  Three  made  his  predictions  for  the 
entire  group  using  no  personal  doc~     -.   The  coefficient  of 
the  prod"*  c'  it  ave! 

documents  was  only  .021  higher  thai',  for  the  predictions  of 
men  without  personal  document         ten  with  personal  doc- 
btnts  the  coefficier      .070  lover  than  for  women  without 
personal  documents.   T  to  believe  that      -.so 

of  personal  documents  does  increase  the  accuracy  of  predict- 
ing grade  point  averages* 

St-  h  this  does  not      bo  hold  true  for 

reements      edictions  for  survival  and  che     >f  curricu- 
lum.  The  porce-  reement      i  counselors'  predic- 
tions for  survival  was  2.1  percent  lower  when  personal  doc- 
uments were  used      ;hose  of  the  students  were  4.0  percent 
lowor.   The  critical  ratios  of  these  pence:  r, 
ps  not  st     ically  significant*  In  the  matter  of  cur- 
riculum ohangCj  the  differences  wer         .      Counselor 
predictions  made  using  personal  docusu     ere  0.6  percent 
lov/er  than  those  made  without  using  the  documents;  students! 
were  9.5  percent  lover. 

Sone  res      save  been  advanced  as  to  why  grade  point 
averages  can  be  predicted  more  accurately  v;hen  p     xl   doc- 
uments aro  used,  hut  surviv       curriculum  changes  are  pre- 
dicted loss  accurately  when  they  are  used.   The  autobiography 
written  by  the  student  is  in  many  ways  an  indicator  of  past 
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ach.     j:it  3.  ng 

in  the  theme  one  can  observe  whether  or  not  tho  student  tends 
to  conform  in  his  school  work*   P        3uccc.  1- 

uros  in  school  r.  Lth 

school   rk«  he  approxla  snt 

school  class 
.1  bofore  (6)  as  one  of  the  be.       .e  criteria 
prediction*   Th  Id  all  aid  in  predict       le 

Lnt  av  r        VvTviv  tially  aJ 

in  the  prediction  of  curriculum  change. 

The  clinician  r  documents  also  ten 

to  "identify"  hi        th  the  he 

rsadin  .   ' t  the  tine  of  enrollment  in  college  whan  he 
writes  tho  document  b  may  bs  car  r- 

who"  or  enthusiasm  about  ths  things  to        Lch 

later  in  hi  r  of  college  would  be  considerably 

If  the  clinician  becomes  to  Ln  these 

itions,  it  would  color  hi3  ability  to  sec  al 

in  his  true  picture.   He  might  take  the  information  in  the 
documents  at  its  face  value,  the  true 

one,  rly  f<  .re  not  matured  to  the 

adult  level* 

?r        f  tho  clinician  exert  rmcl     .!ience 

on  the  ability  of  the  counselor  to  make  the  most  of  personal 
documents.   This  i3  borne  out  by  the  predictions  of  Co\znselor 
Number  Four.  The  use  of  personal  document;.;  increased  coeffi- 
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cientL    correlation  foj  .354  tc  .546  and  for  woman 

from  .516  to  .689,  by  far  t:       st  correlation.   This 
counselor's  tr  almost  entirely  of  a 

cli  ibllhg  her  to  get  more  out  of 

loouments  tl  so  skilled  in  the 

use  i  tech  ^es  the  need  for 

;rainl      individuals  i  use  of  personal  documents. 

It  A  it       the  counselors  or      its  raaki*: 

predictions  h.  -stematic  method  of  correct- 

1  biases.  In  spite  of  this  fact,  the  use  of  per- 
sonal dc  to  be  warranted  and  clinicians  need  to 
le<^                 more  uslT# 

Go:      .  Allport  (1)  states: 

As  •  self  ".revealing  rec     f  experience  and 
conduct  the  personal  document  is  usually  though  not 
always i  /rod-  y,  recorded  by  the  sub- 

ject himself,  and  intended  only  for  confidential  use. 
Its  t:     naturally  revolve  around  the  life  of  the 
writer,  its  manner  of  approach  is  naturally  sub- 

ve  (pi  1) Sometimes  tl     e   de- 

ceptive and  trivial;  but  sometimes  they  represent  dis- 
til ifioant  ex- 
periences of  human  life.   And  always  they  are  inter- 
net as]     n  of  the 
deceptive  and  trivial  documents  why  they  were  written 

tire* 

Lnee  there  are  no  fact.     sycholo      t  are 
divorced  from  personal  lives,  the  human  document  is 
the  most  obviou    L  ?e  to  find  these  facts  in  their 
raw  state. 

It  is  evident  that  personal  documents  aid  the 
Inves  intaining  this  organismio  approach 

that  is  nowadays  regarded  as  essential.   If  nothing 
el-  in  favor  of  the  personal  document, 

this  advantage  alone  would  seem  to  justify  its  wider 
U3e. 
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Our  position is  that  if  the  language  of  per- 
sonal documents  can  be  shown  to  enhance  understanding  , 
power  of  prediction*  and  power  of  control,  above  the 
level  which  nan  can  achieve  through  his  own  unaided 
common  sense,  then  these  documents  must  be  admitted 
as  a  valid  scientific  method.  No  loyalty  to  an  op- 
erational, to  logical,  or  mathematical  creed  should 
prevent  it* 

It  can  be  shown  that  these  critical  tests  of 
science  are  met  by  personal  documents  properly  handled. 

Returning  to  the  matter  of  training  and  experience,  it 
has  indeed  been  shown  to  be  an  important  factor.   In  only  a 
few  instances  were  the  total  predictions  of  any  of  the  stu- 
dents equal  to  or  more  accurate  than  those  of  the  counselors. 
Counselor  Number  One,  whose  training  and  experience  exceeds 
that  of  the  other  counselors,  rated  consistently  higher  In 
his  predictions  than  did  the  rest,   studc     unber  Two,  who 
is  farthest  advanced  in  his  educational  training,  was  more 
accurate  in  his  predictions  than  were  the  other  students  a 
large  percentage  of  the  time.   As  was  mentioned  above, 
Counselor  Number  Pour  was  able  to  make  greater  use  of  her 
clinical  sensitivity  when  personal  documents  were  used  than 
were  those  who  had  had  less  training  in  that  field. 

In  comparing  the  effectiveness  of  the  clinical  predic- 
tion with  that  of  the  statistical  prediction  some  factors 
of  varying  importance  have  appeared.   As  shown  in  Table  1, 
the  four  counselors  ar; d  three  of  the  students  had  higher 
product  moment  correlation  coefficients  for  the  prediction 
of  grade  point  averages  as  compared  with  the  actual  grade 
point  averages  than  did  the  American  Council  on  Education 
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Psychological  Examination*  This,  however,  is  somewhat 
leading,  for  when  a  breakdown  wa3  made,  in  predicting  for  men 
with  no  personal  documents,  only  one  counselor  and  one  stu- 
dent were  able  to  exceed  the  coefficl  ;,  r   uich  was 
.416.   For  women  without  personal  documents  only  two  coun- 
selor     no  students  were  able  to  exceed     ^efficient 
of           hen  personal  documents  were  used,  every  coun- 
selor and  student  exceeded  the  coefficient  of  the  American 
Council  on  Education  Psycho lo      Exaininatic 

This  would  seem  to  disprove  Sarbln's  statement  (17)  "In 
formulating  predictions,  counselors  rely  for  the  most  part 
on  rank  in  the  high  school  graduating  class  and  college  apti- 
tude test  rosults, the  lame  variable  used  in  regression 

equations".   It  might  also  be  pointed  out  that  the  counselors 
in  Sarbin's  study  had  much  more  adequate  clinical  data  than 
did  the  Kansas  State  College  Counselors,  even  when  the  latter 
used  personal  documents.   The  Minnesota  counselors  had  not 
only  personal  documents  but  high  school  rank,  records  of 
interviews,  and  additional  aptitude  and  personality  test  re- 
sults. 

It  would  tend  tc  substantiate  Isador  Chein's  (3)  state- 
ment as  used  in  the  introduction:  "The  clinician  sees  statis- 
tics as  one  tool  in  his  major  methodological  objective  of 
conceptually  or  actually  manipulating  circumstances  to  arrive 
at  an  understanding  cf  the  conditions  of  events." 

The  percentage  of  agreement  for  the  predicted  change  of 
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curriculum  with  the  actual  change  of  curriculum  for  the 
Strong's  Vocational  Interest  Blank  or  the  statistical  criterion 
was  66.5  percent.  The  percentage  for  the  combined  group  of 
counselors  and  students  making  predictions  was  74.8  percent. 
This  gives  a  difference  of  8.3  percent  and  a  critical  ratio  of 
2.02  which  is  statistically  significant  at  ai  out  the  .04  level 
of  confidence. 

In  the  statistical  prediction  of  the  survival  of  the  stu- 
dent through  the  freshman  y ^ar,  two  criteria  were  used:  those 
students  who  had  ranked  in  the  lowest  10  percent  on  the  Ameri- 
can Council  on  Education  Psychological  Examination,  and  those 
students  who  had  ranked  in  the  lowest  20  percent.   Either 
group  gave  the  same  percentage  of  agreement  for  the  predicted 
survival  of  the  student  through  the  freshman  year  with  the 
actual  survival.   Thi3  pereenta;  e,  68.0  percent,  as  compared 
with  the  combined  percentages  of  the  counselors  and  students 
which  was  68.4  percent,  showed  such  a  small  difference  that 
the  critical  ratio  was  not  even  computed,  and  certainly  there 
was  no  statistical  significance  in  the  difference.   There  ap- 
pears to  be  no  difference  in  the  effectiveness  of  statistical 
and  clinical  predictions  for  survival  made  on  this  particular 
sample. 


It  was  the  purpose  of  this  study  to  consider     >ela- 
tive  effectivene      two  method     prediction,  statistical 
I  clinical.   In  doing  so,  the  answers  to  several  questions 

first  question,  "Is  prediction  by  a  single 
o   as  adequate  as  predictions  by  clinical  Judgment*?"  was 
divided  into  two  subdivisions:  "Is  prediction  of  academic 

Llure  by  th  '.ucaticn 

Psychological  Examination  a3  accurate  as  prediction  by  the 
clinician?",  and  "I3  prediction  from  the  Strong's  Vocational 

;erest  Blank  as  to  the  suitability  of  the  student's  curric- 
ulum as  accurate  as  prediction  by  the  individual  counselor 
using  a  batterv  of  tests?". 

In  answer  to  the  question  of  the  accuracy  of  the  predic- 
tions from  the  American  Council  on  Education  Psychological 

amination  as  compared  to  those  of  the  clinician,  the  follow- 
ing scorns  to  be  true:  in  predicting  grade  point  averages,  the 
ACE  is  superior  to  the  clinician  when  the  clinician  uses  test 
scores  alone  upon  which  to  base  his  judgments.   When  personal 
documents  were  added  to  the  test  scores,  the  clinicians  were 
able  to  predict  more  accurately  than  was  the  ACE.   There  ap- 
peared to  be  only  a  slight  difference  between  the  accuracy  of 
the  American  Council  on  Education  Psychological  Examination 
and  the  clinician  in  predicting  the  survival  of  the  student 
through  the  freshman  year  of  college.   This  did  not  vary  when 
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the  students  ranking  in  the  lower  10  percent  on  the  ACE  were 
used  nor  when  the  lower  20  percent  were  used  as  the  criteria. 

Concerning  the  question:  "Is  prediction  from  the  Strong's 
Vocational  Interest  Blank  as  to  the  suitability  of  the  stu- 
dent's curriculum  as  accurate  as  prediction  by  the  individual 
counselor  using  a  battery  of  tests?"  the  answer  appears  to  be 
that  it  is  not.   The  difference  in  percentage  cf  agreement  of 
8.3  percent  was  in  favor  of  the  counselors  and  students.   This 
gave  a  critical  ratio  of  2.02  which  is  significant  at  about 
the  .04  level  of  confidence. 

The  next  question  was  stated  as  follows:  "Is  the  clinical 
judgment  of  the  experienced  counselor  any  more  valid  than  that 
of  the  advanced  student?".   Prom  the  results  of  this  study,  it 
would  appear  that  training  and  experience  do  play  a  consid- 
erable part  in  the  ability  of  the  clinician  to  predict  accurate- 
ly. Although  the  data  are  not  statistically  significant  at  a 
high  level  of  confidence »  a  definite  and  consistent  trend 
seems  to  have  been  established  which  would  validate  this  point* 

A  great  deal  has  been  said  in  answer  to  the  third  ques- 
tion, "Is  the  accuracy  of  the  prediction  from  the  clinical 
judgment  increased  by  adding  the  individual  record  form  and 
the  autobiography  to  the  battery  of  tests  considered?".   In 
this  study,  accuracy  of  the  prediction  of  grade  point  aver- 
ages was  increased  when  these  personal  documents  v/ore  added. 
Percentages  of  accuracy  of  prediction  of  survival  remained 
quite  close  when  personal  documents  were  used  and  when  they 
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were  not,  and  the  percentages  of  agreement  for  curriculum 
change  were  less  when  personal  documents  were  used. 

The  additional  factor  of  greater  accuracy  In  predicting 
for  women  was  one  which  had  not  been  expected.   It  seems 
to  be  borne  out  in  both  the  statistical  predictions  and  the 
clinical  predictions. 

lie  these  conclusions  may  add  to  the  store  of  knowl- 
edge concerning  the  most  effective  methods  of  prediction,  it 
must  be  remembered  that  they  may  be  peculiar  to  our  own 
student  population  at  Kansas  State  College. 

STJGCESTI  J  MICH 

The  outstanding  characteristic  of  the  literature  on  the 
prediction  of  college  grades  Is  the  almost  universal  agree- 
ment that  correlation  coefficients  higher  than  .70  are 
practically  impossible  with  existi;     thods  (19).   In  fact, 
in  a  group  of  over  a  hundred  such  studies  Segel  discovered 
that  the  median  predictive  validities  of  high  school  schol- 
arship, tests  of  general  achievement  or  aptitude,  and  tests 
of  specific  aptitudes  or  achievements  v/ere  .54,  .44,  arid  .37, 
respectively,  (20). 

This  seems  to  be  due  to  several  factors,  most  outstanding 
being  the  unreliability  and  the'  heterogeneity  of  the  most 
frequently  used  criterion — the  honor  point  ratio.  Another 
factor  is  the  reliability  and  validity  of  the  predictive 
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battery.   It  Is  a  well-known  fact  that  one  cannot  create 
tests  which  are  pure  measures  of  any  single  factors.  Present 
day  thinkers  also  recognize  that  spontaneous  and  uncontrolled 
factors  are  always  present.   These  intervening  variables 
cannot  be  foreseen  and  will  introduce  a  measure  of  error  in 
any  forecast. 

Among  such  factors  to  be  found  in  the  prediction  of 
academic  achieveiront  are  momentary  motivations  such  as  health 
conditions,  social  distractions,  3exual  distractions,  home 
conflicts,  temporary  moods,  sets,  fatigue,  and  so  on.   In 
quoting  from  Carbin  and  Bordin  (19)  "because  of  these  not 
readily  controllable  elements,  it  would  be  safe  to  guess  that 
even  with  perfectly  reliable  criteria  and  with  statistically 
infallible  predictive  tests,  the  upper  limit  of  multiple 
correlation  would  still  not  exceed  .95."  This  still  leaves 
us  a  great  margin  for  improvement  over  existing  median  pre- 
dictive validities.   These  men  suggest  that  further  research 
may  take  any  one  of  three  courses:  further  improvement  in 
reliability  an.'  validity  of  predictive  battery;  improvement  in 
the  reliability  of  the  criterion  measures;  or  the  design  of 
a  new  criteria  which  will  be  more  predictable  and  at  the  same 
time  acceptable  to  school  administrators. 

In  the  American  Council  on  Education  studies  (21)  it  Is 
again  pointed  out  that  in  most  research  the  "unknown"  is 
greater  than  the  "known",  there  is  an  inadequacy  of  sampling, 
college  to  college  and  within  colleges  there  is  a 


48 


variability  in  the  quality 

used— usually  th         oint  a  vera  elt  that  th- 

is a  need  for  study  of  the  nonintellectual  corre       '  sue* 
cess,  the  establishment  of  r»es,  i 

improvement  of  the  criteria  used     lasure  the  perfo* 
of  professional  students.   It  is  imperative  thnf  eo liege a 
••  ea     cither  to  study  tho?e  problems. 

Robert   .   .  Travern  {?.?,)    in  his  "The  Prediction  cf 
Achievement"  states  thrt  there      need  cf  r  new  trend  in 
the  approach  to  the  study  of  predictive  achievement.  There 
is  need  of  knowledge  of  the  extent  to  which  commonly  oc- 
curring environmental  variations  affect:  the  achieve      f 
various  outcc -?r.   More  information  is  needed  concerning  the 
outcomes  that  any  pre  rem  of  teaching  is  do     id  to  achieve 
and  valid  measures  must  be  dare  loped  f     ch  of  thai    ;.t- 

3s.  When  one  has  that  knowledge,  v 
will  be  ripe  for  I    repar:  predict 

achievement. 

With  reference  to  this  particular  study,  future  research 
can  well  be  dope.  A  follow-up  sight  be  made  using  the 
sa  d  the  same  criteria  as  they      r  when  these 

students  are  \  -classmen.   New  predictic        ]  then  need 

to  be  made  for  survival  during  three  or  four  years,  whichever 
the  case  might  be.  The  same  counselors  and  student    [  ht 
make  a  c  re dictions  for  this  sample 

group,  testing  the  ability  of  the  clinician  to  predict  the 
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same  when  time  has  elapsed  between  the  first  prediction  and 
the  second  one.   A  study  might  be  made  on  the       of  stu- 
dents who  failed  to  react  as  it  was  predicted  they  should, 
to  ascertain  why  this  occurred.   Research  could  be  done  on 
the  factors  which  seem  to  make  it  easier  to  predict  for 
women  than  for  men. 

>«t  interestin     Id  be  a  study  in  which  the  predic- 
tions would  be  made  en  our  sample  group  by  counselors  and 
advanced  students  from  another  college  or  university  so  that 
the  results  might  be  compared.   It  \  also  be  interesting 

for  these  counselors  and  students  to  analyze  their  errors 
of  prediction  to  learn  how  tc  correct  for  some  of  their 
biases,  and  then  make  predictions  on  another  population. 
It  is  only  by  continuing  such  research  studies  that 
the  evaluation  of  methods  of  predicting  can  advance. 
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